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ABSTRACT 

A simple time series model for bivariate exponential variables 
having first-order autoregressive structure is presented. The linear 
random coefficient difference equation node! is an adaptation of the New 
Exponential Autoregressive mode) (NEAR (2)}. The process is Markovian 
in the bivariate sense and has correlation structure analogous to that 
of the Gaussian AR(1) bivariate time series model The model exhibits a 
full range of positive correlations and cross-correlations. With some 
modification in either the innovation or the random coefficients, the 
model admits some negative values for the cross-correlations. The 
marginal processes are shown to have co. -elation structure of ARMA(2,1) 
models. 



Key Words: Time Series; Bivariate Exponential Distribution; 

Autoregressive Models* -EARJ2); ARMA(2.1) Models; Gaussian 
AR(1) Bivariate Time Series Model. 



1 . INTRODUCTION 

The homogeneous Poisson process i ha.ic model for point processes 
(series of events) and can be character * zed as a process in which the 
intervals between events are independent and identically exponentially 
distributed random variables. On* generalization of the homogeneous 
Poisson process has been to rel tx the condition on independence of 
intervals. The earliest attempts to do his go back to Wold (1948) and 
Cox (1955). See Cox and Lewis (1966, Oh 7) for details. Later, this 
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need for point processes with correlated but marginally exponential 
distributions inspired the creation of a class of ARMA time series 
models for the univariate exponential processes analogous to that for 
the Gaussian processes (Gaver and Lewis, 1980; Lawrance and Lewis, 1981, 
1985). Beyond their utility in point processes, these models are 
utilized in studying queues (Jacobs, 1978; 1980), inventory and water 
resources problems, and other situations where non-negative random 
variables are appropriate for inputs. Using antithetic variables as 
innovation or error structure, these models also allow for negative 
dependence (see Lewis, 1986, for a survey). 

We demonstrate that one of the more recent exponential models with 
ARMA correlation strucutre, NEAR(2), by Lawrance and Lewis (1985), lends 
itself naturally to a first-order bivariate autoregressive process which 
is Markovian in the bivariate sense, and has a structure analogous to 
that of the Gaussian AR(1) bivariate time series model as given in Tiao 
and Box (1981), and elsewhere. Early attempts to construct bivariate 
exponential time series and bivariate Poisson processes are discussed in 
Cox and Lewis (1971). The present model is broader and simpler than any 
previously obtained, including the MEAR(l) model by Raf tery (1982), 
which turns out to be a special case of the present model for the 
bivariate case, and the models of Jacobs (1978, 1980), Lewis and Shedler 
(1977), and Gaver and Lewis (1980). All of these models were defined 
using the NEAR(l) structure, and this does not allow for the breadth 
obtained by using the NEAR(2) structure. 

With the general model it is, for example, possible to construct 
simple bivariate, serially correlated models for the successive up and 
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down times which occur in reliability studies, or for correlated and 
cross-correlated service and interarrival sequences in queueing systems. 

2. THE UNIVARIATE NEAR(2) MOTEL 

By the NEAR(2) theorem (Lawrance and Lewis, 1985), we know that two 
(possibly dependent) random variables with marginally Exponential (X) 
distributions can be combined with three scaled (possibly dependent) 
exponentials which are independent of the first pair, to give another 
random variable that is marginally exponentially distributed with 
parameter X. We assume in the remainder of this presentation that 
X = 1 . The essence of the NEAR(2) theorem is repeated without proof. 



THEOREM (Lawrance and Lewis) 

If {E^} Is an i.i.d. sequence of exponential random variables and the 
parameters a^, /3^, a ^ are such that 0 < <1 for 1 = 1 , 2 ; 



0 < Qj H 


■a 2 < i 


and 0 


< h 


< 1 


and if 


0 * 

II 


Eq. then 




' 01 X n-l 


w.p. 


a i 




E 

n 


w.p. 


1_ P2' P 3 


II 

x c 


h\-2 


w.p. 


a 2 


+ 


b 2 E n 


w.p. 


P 2 




0 


w.p. 


i " a l ” a 2 




b 3 E n 


w.p. 


P 3. 



( 2 . 1 ) 



defines a stationary sequence {X^} which is marginally exponentially 
distributed with X=1 . The quantities b^, b^. Pg- P 3 have values in 
the interval (0.1) and are defined in Lawrance and Lewis (1985); the 
mixture of the exponential random variables on the right in ( 2 . 1 ) is 
called the innovation random variable. 
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A special case of the NEAR(2) model which is not covered by the 
theorem, but obtained directly from the usual analysis with transforms. 



is the 


case when 


= 0 2 = 


1 . 


In 


this case, still 


assuming 


a, « 2 < 


1 , we have 
















X n-1 


w.p. 


a l 










ii 

x c 


X n-2 


w.p. 


a 2 




+ (l-a 1 -a 2 )E n . 


(2.2) 






0 


w.p. 


1_a l 


-*2 







This is the TEAR(2) model. It has two advantages for our purposes; one 
that it only uses two parameters instead of four in the complete NEAR(2) 
model; and the other that it has a simpler innovation structure. The 
model exhibits, however, a "runs-up" behavior in the sample paths. 
Nevertheless, we will use the TEAR(2) model as the base for construction 
of the bivariate exponential model, even though other three- and 
two-parameter subclasses of the NEAR(2) process may be 

phenomenologically more suitable. For example, in hydrology the time 

series which occur generally exhibit a "runs-down” behavior. However, 
the ideas in developing the bivariate process are the same. 

3. BIVARIATE, MARKOVIAN TIME SERIES FOR EXTONENTIAL RANDOM VARIABLES 

Let {X ,Y } be a bivariate sequence of random variables, such that 
n n 

{X^} and (Y n ) are each stationary sequences of marginally 
exponentially distributed random variables with A=l. Then we define 
our first bivariate exponential model, using (2.2), as 

X n * K U )x n-l * K 12 )y „-1 * <1 ‘“ll" a 12 ,E n < 3, > 
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in this equation 



IK ( n ) 

{K n ' 



v( n )\ . 
K 12 ‘ ~ 



(0.1) 


w.p. 


a 12 


(1.0) 


w.p. 


a ll 


(0.0) 


W.p. 


1-a 



11 12 



and are serially independent; 



< 4 ? J - - 



(0.1) 


w.p. 


a 22 


(1.0) 


w.p. 


a 21 


(0.0) 


w.p. 


1-a, 



21 22 



are also serially independent and independent of f° r 

n. Likewise {E^} and {E^} are independent innovation sequences of 



“11 + “12 < 1 



i.i.d. Exponential (X=l) random variables. Finally, we insist that 

and g ^ + a 2 j ^ 1 • If a ll + a \9 = * and 

a 22 + °21 = ^ the process is not ergodic. In this case, (X^.Y^) 

is always one of the pairs (Ej.Ej). (E..E,), (Ej.Ej) (Ej.E^) for all 

n. Note that X r _j and ^n-1 * n ’ e ‘ s ’’ Equation (3-1) are not 

independent; this is the reason for the use of the NEAR(2) construction. 

We observe that (X^) , { are each TEAR(2) constructions in that 

in (3.1) replaced X^^ in (2.1), and similarly X^_j in (3.2) 

replaced Y Also, (X ,Y ) is, given the value of (X . ,Y_ .), 

n-2 v n n' n-1 n-l # 

completely independent of previous values f° r ^ ^ n- ^ f° r 
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all n. Again g ( x n l x n _i = x * Y n _i - Y) is a linear function of (x,y) 

and likewise for Y . Thus, the model is Markovian in the bivariate 

n 

sense, both structurally and in the sense of expectations. 

Note, however, that {X^} and {Y^} are not marginally TEAR(l) 
processes, and, in fact, are not marginally Markovian. In particular, 
their correlations are not necessarily geometrically decaying, as will 
be demonstrated later. If = a 99 = 0, we obtain the bivariate 

exponential process described by Gaver and Lewis (1980). The process 
{Y^} is then called the dual of the process {X^}. 

Clearly, other special combinations of the give other models 

with 1, 2, or 3 parameters. Of course, there could be from 5 to 8 total 
parameters by using the more general NEAR(2) construction. Thus, from 
(2.1), (3.1), and (3.2), replace by 0 k[ > . 0 < 0 tj < 1. One 

requires then, however, the more complicated innovation structure given 
in (2.1) for the innovation in (3.1) and (3.2). 

4. CORRELATION STRUCTURE OF TOE MOTEL 

The marginal processes defined above are exponentially distributed 

2 

with mean 1/A and variance 1/A*“. Thus, if we set the scale parameter 
A equal to 1, correlations and covariance are equal. Since we assume 
(Y n ). (Xjj) are jointly stationary, we have 

^(5) = «(X n X n _p - 1. € = 0. 1. 2. •••. (4.1) 

^YY^> = «(y n _P - 1. « « 0. 1. 2. — . (4.2) 

for the autocovariance functions. Similarly, 
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= «(x n Y n _p - 1 e = 0. ± 1. ± 2. •••. 



(4.3) 



is the cross-covariance function. 

The following results are immediately obtained using (3.1), (3,2), 
(4.1) - (4.3) and the stationary assumption: 

” r XX {0) " = 1: (4-*) 

y XY (0) = nr YX (0) = ( a 22 a 12 + a ll a 21 )/{1 " (a 22 a ll + a 21 a 12 )}; (45) 



1 

a 

II 

w a 


for all 2; 


(4.6) 


^yyC^) = ' r YY (~^) 


for all 


(4.7) 


1 

w 

5 

II 

w 

6 
*- 


for all €; 


(4.8a) 


w 

II 

4 

1 

w 


for all i. 


(4.8b) 



Autocovariance functons are even functions of the lag € , but the 
cross-covariance is not. 

The range of ''xY^^ = as given * n ( 4 -5) is t ^ ie range 

of non-negative values up to one. Using the Generalized Reduced 
Gradient (GRG) algorithm, we find that the maximum takes place along the 
boundary + fc = 1 and + a ^ + e = 1 for arbitrary e > 0, 

in which case we obtained coyariances as close to one as desired. Of 
course, for strictly positive that satisfy the original 
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constraints, cannot be negative. We show in Section 5 how to 
incorporate negative correlations into the model. 

Using Equations (3.1), (3.2), (4.1)-(4.8) and the stationary assumption, 
we obtain the following recursion equations for ,xx ( *). v(«>* 
^(5). 



^(5) - l ) + a l2 1r YX^ 

^YY^) - a 22 nr YY^ -1 ^ + ^l^XY^ -1 ^' 

' r Y X (*> = a 2rXX (€_1) + WVX^" 1 ^ 

^(5) = a^-tYYf^-l) + “h^xyC^" 1 ). 



e = 1 ,2, • •• , 
€ = 1 ,2, •• • , 
£ = 1 .2, • • • , 
« = 1 .2, • • • . 



(4.9) 

(4.10) 

(4.11) 

(4.12) 



It remains to show that these equations correspond to those given 
by, for example, Tiao and Box (1981), for the AR(1) Gaussian bivariate 
time series. We introduce the following matrix notation: 



r(«) 



^XX^ ' r XY^ 

"^YX^) 



£ = 0. 1 .2, • • • . (4.13) 



is the covariance matrix for lag B. Equations (3.1) and (3.2) become 



X = K X , + 
n n n-1 



AE 



n 



(4.14) 
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where 





’ 1 "“ll" a 12 


0 




X 1 
n 


A = 


0 


l-a on -a ft1 


II 

x c 


Y 






22 21 J 




n 



and 



K = 
n 



E = 
n 



K 



n 



E' 

n 



(n) 

11 



K 



(n) 

12 



4 ;’ 



K (n) 

*22 



The matrix- valued random variable X assumes 9 different 

n 

matrix-values independent of and and retains the property that 

for all i, j, n. Then 

*(X n ) = «(K n )g(X n _i) + A <(E n ) (4.15) 





a ll 


a 12 




' 1 




0 




' 1 




‘ 1 




. “21 


a 22 . 




1 




0 l ~ a 22~ a 21 




1 




1 



Also, 

r ( °) = ia*l) - nxjnxl) - t(xxl) - [j ;] 

* ‘(Wn-l + “/> - [! !] 

= £ (X n (K n x n .,) T ) * e f x n (* E n ! T ) - [1 1] 
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- ‘« K „ X „-1 * * E „>< K n X „-l> T > + ‘« K „ X „-1 + ' [l l] 

= «(K„ x n _, (K^.,) 1 } * { {*E n (K n X n . 1 ) T ) + «{K n X n _ 1 (Ae/) 

* - [! !]• 

Thus 



r(0) = «(K X ,X T . K T ) + «(AE X ,K T ) + &(K X . E T A^ ) 
v * v n n-1 n-1 n' v n n-1 n J v n n-1 n ' 



T T 

«(AE EV) 

v n n ' 



-l! !) ■ 



(4.16) 



Solving (4.16) yields the results given by Equations (4.4) and (4.5). 
Furthermore 



r <‘> - e vh) - { (x n )t(x^> = £(x n x^,) - [; ;] 

* { « K n X n-l * “„><-!> - [! !] 

- «oyr ( «) ♦«c»y [; ;] ♦ A t( E n xj;.,) - [; ;]. 

Thus 



r(i) = «(K n )r(o) = 



a ll a 12 
a 21 a 22 



r(0). 



(4.17) 
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Again 



p (-D = - [1 !' 

- « X n< K n + l X » * «„/> - [! }] 

= j < x „ x I x L> * i ( x A.y - [! !]• 

Thus 

r(-i) = r(o)«(K^ +1 ) = r(i) T . (4.18) 

Clearly T(-l)^ = T(l). Because of (4.8a,b) and (4.13), we have 

F(-£) s r(t ) 1 (4. 19) 



and 



r(£) = 



“ll G 12 



a 21 a 22 



T(0) for all £ - 1,2, 



( 4 . 20 ) 



Now Equation (4.20) is the result given by Tiao and Box, (1981, 
p. 804). Therefore, the auto- and crcss-covariances in this bivariate 
exponential process in general decay gradually to zero as \i\ 
increases, for the values of that satisfy the conditions in 

Section 3. Numerical examples are given in Section 6. and further 
discussion of the auto-correlations is presented in Section 7. 
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In principle, one can use standard estimates of auto- and 

cross-correlations (Kendall and Stuart, 1983, pp. 661-662) to obtain 
estimates of T(0) and T(l) as 



and 



1 



C(0) = 



Sx* 0 * 



Scy(°) 

1 



C(l) 



CxxO) 

Cyx(l) C yY ( ^ 



(4.21) 



(4.22) 



Then (4.20) yields estimates of 



°ir “21' a 12* a 22 as 



“ll a 12 

/K A 

a 21 a 22 



= (C(1)){C(0)} 



(4.23) 



Like most moment estimates, these are likely to be fairly poor for small 
sample size. 

An example is given in Table 4.1 where we have performed a 
simulation of the estimation of a i 2 ’ a 21 a 22 ^ 5ase< ^ on (4.23). 
Here 10 replications were used and the true values were = 0.70; 
a 12 = a 2i = 0.30; = 0.50. The 10 series were run out to 
n = 600 and the first 100 values were discarded as being nonstationary. 
The boxplots in the tables show the distribution of the tabulated values 
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in the columns. The estmates show no evidence of departure from 
normality, although the number of replications is small. 



TABLE 4.1 



Replication = 0.70 a ^ = 0.20 a = 0.30 a ?2 = 0.50 



.27 



.32 



6 

T 



.37 



.71 



.91 



0 



.22 



.01 



.33 



.23 



. 33 



.23 



O 

♦ 

T 



.32 



■ 39 



.20 



.22 



5. NEGATIVE DEPENDENCE 

As pointed out in the last section, the first bivariate exponential 

model discussed above can produce only positive correlations. Negative 

correlation is obtainable in one of two ways - through correlation in 

the bivariate innovation {E ,E*} and/or through the correlation in the 

n n 

attenuation controlled by the . These ideas are relaxations of the 

conditions established in Section 3 where {E } and {E’} are assumed 

1 n' v n' 
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to be i.i.d. exponential sequences and is 8111 independent 
identically distributed bivariate sequence independent of {^21 • ^ 22 ^) 
for all n. 

It is easy to see that these schemes affect directly only the zero 
lag covariances, r(0), and that (4.20) still holds. Thus, it is only 
necessary here to derive the effect on T(0) of correlation in the 
innovation or attenuation sequences. 

5.i. Correlated Innovations. 

As a first example, consider the model of Section 3 and let 



■ 



a 

0 



k=0 

otherwise. 



(5.1) 



Now Equation (4.5) becomes 



''XY^ 



( a ll° E 21~ H0t 12 g 22) * ^ 1 ~ g 1 l~ g 1 2^ 1 ~ a 21~ g 22^ g 
1 ~ ^ a l l°22 +a 12 a 21 ^ 



(5.2) 



Moran (1967) showed that if (E^) and {E^} are pairs of exponential 

random variables with X = 1, then -.6449 < a £ 1. If E‘ = a(E ), the 

n v 



n' 



antithetic transform of E^ (see for example Gaver and Lewis, 1980), 
then a takes on its maximum negative value. It is clear that if 
a < 0, then (5.2) could be negative for some choices of the a^'s. 
The process cannot be uncoupled as described previously. 

Estimation of a proceeds as before. The parameters a n» a j2* 
a 21 ’ a 2 2 are est * inate ^ by (4.23) and then (5.2) can be easily solved 
for an estimate of a. 
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5.11. Correlation in the Random Coefficients. 



Consider now the model of Section 3 in the form of (4.14). 

'(n) 



n 



defines a quadruple where each Kjj' has a marginal distribution and each 
row has an independent bivariate distribution for each n. If is 
now defined so that the rows are not stochastically independent of each 
other, then (4.5) becomes 



7 Xy(°) = 



^ a ll a 21 +a 12 a 22^ * ^ll. 21*^12. 22 4g l 1.22^12. 21^ 



1 - (“nVisfti) " a 



11.22 



- a 



12.21 



(5.3) 



where 



‘ Cov(K^.K^ +k h k = 0 

0 otherwise. 



(5.4) 



This correlation must be introduced in such a way that the marginal 

distributions are not altered. This may not be easy. 

The following example using for all n demonstrates 

the above ideas. Define K as follows: 

n 



v( n ) v( n ) 
K 11 K 12 

v(n) K (n) 
*21 K 11 



= K 



n 




a ir 

a 21 a 12’ 

a 12 (1_a 21 ) - (55) 
a 21^ 1 ~ a 12^’ 

1 ~ ( a n +a i 2 +a 2 l" a 12 a 21 ^* 



15 
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where a n . a 12> a 21 as before, and also 0 i a u +a i2+ a 21~ a l2 a 21 * 

It is easily verified that the marginal distributions of the quadruple 
are retained and. specifically, that 



4 <V 



11 


a 12 


21 


“ll 



(5.6) 



For K n defined by (5.5) we have, from (5.3) 



' r XY (0) 



a ll(l~ (a l 1^12^21 )} 
1 - < B n^i2fti>' 



(5.7) 



This follows because 21 - a 12.22 “ "“^“lT a ll,22 ~ 

aj^l-a^) and a 12 21 =0. with 0 $ a n +a i2 ^ 1; 0 ^ a ll +a 21 ^ 1: 

0 i a n +a i2 +a 21 -a 12 a,> l ^ * ' Using again GRG, we find ' r xY^^ attains 
the full range of positive correlations as before. It has a max 

negative correlation of -.125 at = .25. a^ 2 = = .5. This 

corresponds to one of the cases where / 0 for any n. 

Considering the bivariate model with given by (5.5) and with 

= 0, we see that Tr^y(2k) = 0 = iy^(2k) . k = 0,1,2,»»*. Resolving 
(4.9) - (4.12) yields 



H k) 



0 




a, 



21 



0 



k = 1.2. ••• 



and 



1 



r( o) = 



0 



0 

1 
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This is the correlation structure of the dual process of Gaver and Lewis 
(1980). No negative correlation is possible in this configuration. 

Lewis and Lawrance (1981) considered the model with correlation in 
the random coefficients and made Kj 2 ^ and have the maximum 

possible negative correlation, obtaining 

l w (0) = 1 r-2- < 0. 

XY 1 - (a+a 12 « 21 ) 



where 



a - Cov(K^, K^) = CT i2.21 * °' 



Considering the bivariate model with K given by (5.5) with 

a^ 2 = a 2 j = 0, then T^yCO) = and the resolution of (4.9) - (4.12) 

with (5.7) yields the following structure. Marginally (X n ) and (Y^) 

are univariate TEAR(l) processes, since the Y^’s do not appear in the 

€+1 

definition of the X^’s and vice versa. Moreover, = a u 

= ' r YX^^' ^ = 0«1*2.***. Therefore, there is no negative correlation 

nor any way to uncouple the bivariate process into two independent 

univariate TEAR(l) processes unless = 0. Of course, if = 0, 

there is then no dependence in the marginal processes either. The 

bivariate process with / 0 is shown in the next section to have 

Moran’s Bivariate Exponential distribution. 

Finally, we observe that if a n +a 12 +a 2l = * * n (5*7), we have 

^wtO) = 0- Thus, the pairs (X ,Y ) are uncorrelated for all n and 
XI n n 

yet the processes {X^} and {Y^} are not at a ^ independent. This 



n 



can be seen from the fact that = a 1Q / 0 and ' r Y y( 1 ) “ a 91 * 



12 



YX V 



‘21 



11/5/86 



17 



LEWIS/DEWALD 



5. ill. Correlated Innovations and Random Coefficients. 

If there is dependence from both the innovation and cross-coupled 
attenuation, then a general expression for (4.5) becomes 



XY 



( 0 )= 



{( a 21 a ll +a 22 a 12^^ ? ^11.21 +2q 12.22 +g ll. 22 +q 12. 21^ + ^ 1 ~ a ll~ g 12^ 1 ~ a 21~ g 22^ 



1 - (a 



12 a 21 +a 22 a ll 



* “ ^ a 12,21 +CT ll .22^ 



(5.8) 



The interesting point to be made here is that the effects are additive 
in the numerator of (5.8). This general model is called the BEAR(l) 
model. 

6. NUMERICAL EXAMPLES OF COVARIANCE MATRICES. 

The form of r(£) given in (4.20) can be misleading. Since the 
form of r(€) is analogous to that of a univariate AR(1) process, one 
might think that the elements of T(£) should experience a geometric 
decay as ji] increases. In fact, auto- and cross-covariances can 
exhibit many different patterns depending on the innovation and the 
attenuation structures of the model. Some illustrative examples follow. 

In Table 6.1 an example is described where ^XY^ ls S iven by 
(4.5). Although the auto-covariance functions decrease monotonically, 
it is not at all like a geometric decay. 

In Table 6.2, an example corresponding to ^,(0) as given in (5.2) 
is exhibited. This case demonstrates that negative correlation in the 
bivariate innovation can create negative cross-covariances at lag zero. 
It can also cause oscillation in the values of the auto- and cross- 
covariance functions at subsequent lags. Also, note for this example 
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we can 



that simply by interchanging for and a 2 \ f° r a 22 

create another bivariate series with the same r(0), but with auto- 
covariance functions ' r jg((^) and ^yY^^ that are almost geometrically 
decaying. 

In Table 6.3, we give a final example corresponding to from 

(5.3). It is, in fact, the example given for in (5.5). Again, 

Tfxy(O) is negative. However, note that although the auto-covariance 

functions are generally decreasing, the movement is not monotone as in 
Table 6.1, and certainly not decreasing geometrically. 

It is apparent from all examples that as \e\ increases, r(£) 

approaches the zero matrix. In fact, since the eigenvalues of the 
matrix are less than one, the components of T(5) all decrease to zero. 



TABU) 6.1 Covariance Matrix Corresponding to (4.5) 





“ii - 2 


a 12 ” 


“21 * 3 


«22 = -5 


e 


“xx<*> 


•>„(«) 







0 


1.0000 


0.5942 


0.5942 


1.0000 


1 


0.6159 


0.5971 


0.8188 


0.6783 


2 


0.5412 


0.4833 


0.6386 


0.5848 


3 


0.4466 


0.4040 


0.5371 


0.4840 


4 


0.3721 


0.3360 


0.4462 


0.4031 


5 


0.3096 


0.2796 


0.3714 


0.3354 


6 


0.2577 


0.2327 


0.3091 


0.2791 


7 


0.2144 


0.1936 


0.2572 


0.2323 


8 


0.1784 


0.1611 


0.2140 


0.1933 


9 


0.1485 


0.1341 


0.1781 


0. 1609 


10 

• 


0.1236 

• 


0.1116 

• 


0.1482 


0.1339 

• 

• 


• 

25 


• 

0.0089 


• 

0.0081 


• 

0.0106 


• 

0.0097 



i i /cr /nc 



i r\ 



i rrwTc/nxrwAi n 



TABLE 6.2 Covariance Matrix Corresponding to (5.2) 


“11 = - 05 


a 12 ~ * 60 


a 21 “ a 22 “ ' 01 




a = 


-.6449 


e 


’yx(*> 


^XY^) ' ^YY (<) 



0 


1.0000 


-0.1411 


-0.1411 


1.0000 


1 


-0.0347 


0.3986 


0.5929 


-0.0464 


2 


0.2374 


-0.0099 


0.0018 


0.2367 


3 


0.0059 


0.0949 


0.1421 


0.0031 


4 


0.0572 


0.0033 


0.0090 


0.0569 


5 


0.0048 


0.0229 


0.0346 


0.0042 


6 


0.0140 


0.0021 


0.0043 


0.0139 


7 


0.0020 


0.0056 


0.0086 


0.0019 


8 


0.0035 


0.0009 


0.0016 


0.0035 


9 


0.0007 


0.0014 


0.0022 


0.0007 


10 


0.0009 


0.0002 


0.0005 


0.0009 



TABU. 6.3 Covariance Matrix Corresponding to 


(5.3) 


!fi 

II 

tH 

i-H 

a 


®12 = 60 “21 = 40 


a 22 = ,25 


CT 11 .22 " 1 


“12.22 = 15 “ll .22 = 1875 


CT 12.21 = 0 


4 ’xx< 4 > 


y^t) y^e) 





0 


1.0000 


-0.1225 


-0.1225 


1.0000 


1 


0.1765 


0.3694 


0.5694 


0.2010 


2 


0.2659 


0.1629 


0.2629 


0.2780 


3 


0.1642 


0. 1470 


0.2325 


0.1747 


4 


0.1293 


0. 1024 


0.1629 


0.1367 


5 


0.0938 


0.0773 


0.1227 


0.0993 


6 


0.0698 


0.0568 


0.0903 


0.0739 


7 


0.0516 


0.0421 


0.0669 


0.0546 


8 


0.0382 


0.0312 


0.0495 


0.0404 


9 


0.0282 


0.0231 


0.0366 


0.0299 


10 


0.0209 


0.0171 


0.0271 


0.0221 
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7. TOE MARGINAL PROCESS. 



Writing K = t( K n ) 
relationship 



a ll a 12 

“21 “22 



we have from (4.20) the 



r(e) = K*r(o). 



(7.1) 



Further, since K is a square matrix, the well-known Caylay- 
Hamilton Theorem proivdes that there exists constants and <f> 2 , 

such that 



K 2 ~ *jK - = 0. 

Applying this result to (7.1) yields 

r(«) - *jr(«-i) - <t> 2 ne-2) = o. e 12. (7.2) 

The difference Equation (7.2) applies to each element of the matrix 
T(fi). Hence, for example, the autocorrelation function of (X n ) 
satisfies 



p XX (e) " Vxx {£-1) " *2 P XX ( *" 2) = °* * 2 2 - 

Thus, in general, (X^) has the corre i a tion structure of an ARMA(2.1) 
process. In addition, the lag 1 autocorrelation may be derived from 
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(7.1) when 1 = 1. In particular, ^xx^ 1 ) = a irxx (0 > + “^YX^' 01x6 

since ''^(O) ~ ' T yy(®) = 1 • we fl n <l that P XX (1 > * a ll + “12 P YX (0 >- 

Further, the constants and <f> 2 b® obtained in terms of the 

elements of K. It may be shown directly that <f>j = 

<f >2 - (a^ r ,g i~g a 99 ) . Thus, in summary, the autocorrelation functions 
for the marginal processes {X^}, {Y n } satisfy 

p(S) = (a 11 +a 22 )p(£-l) + (a 12 a 21 -a lia22 )p(£-2) , (7.3) 

for £ £ 2, and 



Pxx(!) = “n + a 1 oPYY ( 0 ). 



11 



12 K YX V 



(7.4) 



Pyy ( 1 ) = “oo + a oiPYv(°) 



22 



21 K XY' 



(7.5) 



In general, {X ^ and {Y } have correlation structures of 
n n 

ARMA(2,1) processes. In any particular case, their actual form will 
depend upon the values {a^}. The marginal processes will have 
ARMA(p.q) correlations, where p i 2 and q £ 1. We illustrate these 
ideas with some examples. 

(i) Using a ^2 = ^ =0 results in the X and Y processes being 

independent TEAR(l) processes. From (7.4) and (7.5), 
Pj^fl) = a il’ P YY^ = a 22’ and using ( 73 ) we obtain 

'll and *yy ( 0 = a L 



£ £ 

pyy(£) = a. 1 and Pyy(£) = g„ 9 . The bivariate system has 



"XX 
become 



X = K^X . + (l-g.JE 
n 11 n-1 v 11' n. 
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where P(K^^=1) = “jj and P(K^^=1) = 0.^2' and 

lvi\ 

Ka«/ are independent, as are E and E’. 
zz n n 

(ii) Using a u = a o<> = ® leads to coupled processes, each with 



AR(1) 



correlation structure. 



Now, p^l) = a \2 p and 



YY V 



(1) = a 21 p ’ w ^ ere P = Pw(®) • From (7.3) we may derive 



YX 



Pxx (2k) = (a 12 a 21 ) k 
P xx ( 2k +!) = (“ 12 a 2p a 12 p ■ 



k = 0, 1 , ♦ * * . 



This is the formulation used by Gaver and Lewis (1980) to 
derive negatively correlated processes. In effect, they chose 
a 12 = ctgj = a, and so 



<> x ( k ) 



k 

a p 



k even 
k odd. 



Now, from (5.8) or (5.2) with the choice of K used here, 

p = Py^(0) = (l-a)p FF , (0)/(l+a) , and choosing and to 

be negatively correlated results in a sign-switching 

autocorrelation for {X ) and {Y }. 

1 n' 1 n' 

(iii) Using = a ^ = 0 may yield a process with ARMA(1,1) 

correlation structure. The bivariate system is now 
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where p = p ^(0), as before. Further, Equation (7.3) reduces 
to p(5) = a 22 p (*” !)• * ^ 2 * Hence, PyyC^) = 5^0. and 

Pxx(^) = ( a i2 p ^ a 22 • € * 1# ( Y n ) is a Process with 

AR(1) correlation structure, as may be seen directly from 
(7.6). In addition, {X^} is a process with ARMA(1,1) 
correlation structure, provided PyX^^ ^ ^ particularly 

simple way to achieve this is to take = E^. The process 

given by (7.6) is then very closely related to the EARMA(1,1) 
and DARMA(l.l) processes of Jacobs and Lewis (1977,1983). On 
the other hand, we can choose negatively correlated with 

E^, e.g., its antithetic, and may then induce negative 

correlation in {X }. 

(iv) In order to generate the autocorrelation function corresponding 
to an AR(2) process, it is necessary that p(5) satisfy the 
difference Equation (7.3) for 5=1 also. Using p{— 1 ) = p(l) 
this condition becomes p(l) = ^/(l-^)* Rewriting this with 
the appropriate values for <t> j, and using the definition 

of ^XX^^ given by (7.4) yields the condition 



P = 



a 22 * a ll^ a 12 a 21~ a ll a 22^ 
a 12 ( 1+aj i a 22~ a l2 a 21 ^ 



(7.7) 
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where p = Py^iO) , as before. In a model In which X R and 
are independent the condition becomes 



a 22 + a ll^ a 12 a 21~ a ll a 22^ ~ °* 



(7.8) 



In this latter case, the condition (7.8) may be satisfied by 
choosing either: (a) = 1; or (b) = 0 and 
a ll a 12 a 2l = < ^ ase ( a ) leads to example (i) above, i.e., two 
independent processes, each with AR(1) correlation structure, 
one of which is degenerative. X = X , . Case (b) leads to a 
variety of possible models similar to those discussed in the 
previous examples, and one we have not noted yet, a process 
with Moving Average of order 1, MA(1), correlation structure. 
If a n = a 2 i = a 22 “ t * le bivariate process is 



X = kJ^Y . + (l-a 10 )E 
n 12 n-1 v 12' n 



Y = E‘ . 
n n 



Thus, if E = E’, then (X ) has the correlation structure 
n n 1 n' 

of a MA(1) process and (Y^) is a sequence of i.i.d. 
exponentials. 

Hence, we cannot derive an AR(2) structure using (7.8). We require 
dependence between X r and Y^ and the satisfaction of condition 
(7.7). Since the relationship between and P FF ■ (0) given by 

(5.2) and the condition (7.7) are fairly complex, we shall not attempt 
any general analysis. We note only that it is certainly possible and 
give an example. 
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If (E ,E’) have an instantaneous correlation of 0.5, then 
n n 

p = 4/17. from (5.2). and (7.7) is satisfied by otjj = 0, = 0-5. 

a 21 = and a 22 = This choice of K and the correlation 

between E and E' yields a process (X } whose autocorrelation 
n n n 

function satisfies 

P XX^) ~ + 0.15Pxx(£-2). 

for all € 2 1. In passing, we may note that {Y^} in this process has 

the correlation structure of an ARMA(2,1) process. 

We now consider the general case, i.e., the process with ARMA(2,1) 

correlation structure, and note some of its properties here. Solutions 

of the difference Equation (7.2) depend upon the behavior of the roots 

2 

of the quadratic equation Z - $ Z - = 0. It is easily verified that 

with our restrictions on (a^ } we have: ^ ^ < ' 1 • 0 < < 2 and 

-1 < ^ ^ 1* These ensure that the roots of the quadratic lie within 

the unit circle (See Box and Jenkins, 1976, p. 58-59, for a discussion 

of this). However, we may also demonstrate that the roots are real. 

o 

The condition for this is + 4<p^ 2 0, and 

^1 + 4 *2 = ( a n +a 22^ + 4 ( a l2 a 21~ a l l a 22^ 

= ( a n _a 22^ + 4a l2 a 21 * °' 

Figure 7.1 shows the region in which will lie for these 

processes. It is worth comparing this region with the more general one 
available for a stationary process with an AR(2) component. It is given 
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in Box and Jenkins (1976, p. 59), and is defined by ^ ^ * *• 

- $2 ^ “!• “1 < ^2 ^ *' * n our case » only positive is possible, 

and the characteristic quadratic has only real roots. The most 
important effect of this latter property is that the autocorrelations 

are all positive if p{ 1 ) is positive. We have seen in the examples 

above that this restriction is not necessary in the cases when the 
autoregressive component is first order. Also, we can introduce 
negative autocorrelation at lag one using (7.4) and (7.5) and negatively 
correlated (E n «E^). This may persist for higher lags depending on ^ 
and $2 as * n t * ie numerical examples. 




Figure 7.1. Region of (♦j.^) for the bIvariate exponential process. 
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8. JOINT DISTRIBUTION OF (X n .Y Q ) 

We turn our attention to the formulation of the joint distribution 
of (X n .Y n ) ^ investigating the joint Laplace-Stielt jes transform. 
For the initial bivariate model described in (3.1) and (3.2), the 
expression for the transform 



Y ( s ' t ) * « {e3cp(~ sX n - tY n ) > . (8.1) 

n n 

is very complicated. 

However, two special cases are easily verified, 
for all n in (3.1) and (3.2), we have 
simplification 

= [jjjjfilj] • (8.2) 



if k<") - 4;) = o 

after considerable 



This tallies with the result of Section 3 that under these conditions 

(X^) and {Y^} are independent univariate TEAR(l) processes, the first 

k / 

with correlation structure p^(k) = » the second with p ?? (l) = a^. 

If. in addition. = K n and 



1 w.p. a 

0 w.p. 1-a 



(8.3) 



then the distribution of (X ,Y ) turns out to be Moran’s Bivariate 

v n n ; 

Exponential distribution. Using (3.1) and (3.2), we have from (6.1) 

*x Y = «(exp[-s{K n X n _ 1+ (l^a)E n } - t^Y^l-a^;}]] . (8.4) 
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Using the independence of (E^) and {E^} , the stationarity of (X^, Y^} 
and conditioning on K n , we have after simplification 

^(s.t) = ( i +s){1 J t) _ ast • (8.5) 

Equation (8.5) is the Laplace-Stielt jes transform for the Moran 
Bivariate Exponential Distribution as given in Johnson and Kotz (1970, 
p. 267). 

9. CONCLUSIONS 

The NEAR(2) model has been demonstrated to yield a Bivariate First 
Order Autoregressive process with exponential marginals by cross- 
coupling and auto-coupling the two marginal processes. The process has 
the same correlation structure as the Gaussian Bivariate AR(1) process. 
The results for another bivariate process with exponential marginals 
that was proposed by Raf tery (1982) using the NEAR(l) structure of 
Lawrance and Lewis (1981) hold only in very special cases. Even then, 
as we have shown, the correlation structure is identical to the Gaussian 
AR(1) model. 

The possibility of negative correlations was explored using the 

ideas of correlated innovation and/or cross-correlated attenuation. 

These situations occur frequently in modelling physical phenomena. For 

example, the same shock at time n to a system produces related effects 

in components given by and Y^. Likewise, if and Y^ are 

flows in a river at two different points along a bank, then E = E* 

n n 

represents a common phenomenon driving both series. Finally, when both 
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series are TEAR(l) series linked by a common attenuation and independent 

innovations, the bivariate distribution of (X ,Y ) was shown to be the 

n n' 

familiar Moran distribution. 

Taken together these options include numerous possibilities to model 

exponential bivariate time series. There is still much work in 

parameter estimation before these models can be widely applied. They 

certainly lend themselves at this time to an analysis via simulation. 

One other detail which could extend the utility of the model needs 

to be pointed out. This is that Y - in (3.1) could be replaced by 

n i 

Y and X , in (3.2) could be replaced by X ... The model is 

n-€ n-1 v n-£ 

still well defined and has obvious physical interpretation. Properties 
of this extension of the model will be addressed elsewhere. 
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